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(57) An object presence detection device, of the 
type mounted to a motor vehicle having at least one 
blind spot, where the detection device is for detecting 
an object situated in the blind spot, comprises: a receiv- 
er for detecting electromagnetic waves, comprising a fo- 
cussing device, and a light detector converting said re- 
ceived electromagnetic waves into electrical signals; an 
electronic circuit converting the electrical signals into 
digitized signals; a logic circuit analyzing the digitized 
signals to analyze the presence of objects in the blind 
spot which are moving relative to the vehicle, and emit- 
ting variable output signals depending on the result of 
the analysis; indicator members activated by the output 
signals, suitable to be perceived by the driver. 
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Description 

[0001] The invention relates to an object presence de- 
tection devic , of the type mounted to a motor vehicle 
having at least one blind spot, where the detection de- 
vice is for detecting an object situated in the blind spot. 
[0002] Conventional motor vehicles are usually pro- 
vided with rear view mirrors, generally one internal mir- 
ror and one or two external mirrors, which allow the user 
or driver to see behind without the user having to turn 
his or her head around. Nevertheless, in spite of having 
a plurality of mirrors, there are usually areas, known as 
blind spots, which are not covered by said mirrors. 
[0003] There is known the use of systems which cap- 
ture an image orientated towards a blind spot by means 
of a CCD camera and show it to the user on a screen 
located in the vehicle passenger compartment. These 
systems make it possible for the user to see in the blind 
spots without having to move himself, nevertheless, 
they have a number of drawbacks: they require image 
transmission systems having a sufficient quality for the 
user to perceive a clear picture, which requires working 
with a high number of pixels, there must be space in the 
passengercompartmentto be able to accommodate the 
corresponding screen, the system does not process the 
image but only transmits it, etc. They are, therefore, ex- 
pensive systems which do not cooperate actively in the 
detection of situations of risk. 

[0004] It is therefore an object of the invention to over- 
come these drawbacks. This object is achieved by an 
object presence detection device of the type first men- 
tioned above, which comprises: [a] a receiver for detect- 
ing electromagnetic waves, comprising a focussing de- 
vice, and a light detector converting the received elec- 
tromagnetic waves into electrical signals, where the light 
detector defines an image surface, [b] an electronic cir- 
cuit converting the electrical signals into digitized sig- 
nals, [c] a logic circuit analyzing the digitized signals to 
analyze the presence in the blind spot of objects which 
are moving relative to the vehicle, and generating vari- 
able output signals depending on the result of the anal- 
ysis, [d] indicator members, activated by the output sig- 
nals, suitable to be perceived by the driver, the passen- 
ger or, in general, by any passenger of the vehicle. 
[0005] In fact, a detection device of this type captures 
the blind spot image and analyzes it, informing the driver 
of the result of the analysis. This affords a number of 
advantages: the driver is not shown the blind spot im- 
age, whereby it is not necessary to have space in the 
compartment for a screen, the conductor is additionally 
provided with information of "greater value" in the sense 
that the detection device has already effected an anal- 
ysis and the driver or user is provided with the result of 
the analysis. Furthermore, the detection device requires 
receivers with a smaller number of pixels than required 
to provide the driver with an image of the blind spot hav- 
ing a minimum quality, whereby the detection device 
may be equipped with cheaper receivers without any 



loss of performanc . 

[0006] The detection devic not only analyses th 
presence of an object in the blind spot, but provides a 
qualitative idea of the speed of the object relative to the 

5 vehicle and, therefore, determines whether the object is 
approaching or receding, with an approximate idea of 
the speed. This allows fuller information to be provided 
to the driver, since he may distinguish different levels of 
risk depending on the relative speed of the object. 

10 [0007] The detection device also provides a qualita- 
tive idea of the distance of the object relative to the ve- 
hicle and, therefore, determines the position of the ob- 
ject relative to the vehicle. This allows fuller information 
to be provided to the driver, since he may distinguish 

15 different levels of risk depending on the position of the 
object. 

[0008] The light detector is preferably a set of sensor 
elements which are advantageously photodiodes, dis- 
tributed according to a flat two-dimensional matrix de- 
20 fining mutually parallel rows. In this way, the sensor el- 
ement matrix defines the image surface, which is formed 
by a plurality of pixels, where one sensor element cor- 
responds to each pixel. 

[0009] The photodiodes convert the electromagnetic 
25 waves into an electrical current. This electrical current 
is preferably converted to an electrical voltage and is 
amplified. 

[0010] The light detector is preferably formed by ac- 
tive sensor elements having a dynamic range of not less 
30 than six decades (10 6 = 120 dB) on one same image 
surface, i.e., between the minimum detection threshold 
value and the saturation threshold there is a range of 
six decades, with the light intensity being expressed in 
lux. Likewise, a pixel which at any one time is receiving 
35 the minimum detection value, may detect in the follow- 
ing image acquisition a value six decades greater, and 
vice versa. This allows the receiver to operate in a vari- 
ety of light conditions, and even under adverse light con- 
ditions, with powerful light contrasts, such as when driv- 
40 ing at night. It is for the same reason preferable that one 
same sensor element should have a dynamic range 
equal to or greater than six decades between two con- 
secutive images. 

[0011] The electronic circuit is preferably capable of 
45 selecting each of said sensor elements by activating the 
corresponding row and the corresponding position in 
said row, it thus being possible to select any sensor el- 
ement subsequent to any sensor element. In this way, 
the electrical signal from each of the sensor elements 
50 may be taken and all the pixels forming the image sur- 
face may be sequentially amplified and digitized. Alter- 
natively, it is also possible for the electronic circuit to 
simultaneously convert all the electrical signals from a 
row of sensor elements to digitized signals. Thus, in 
55 each particular design, the higher cost of this solution 
relative to the greater speed of digitization of the image 
must be evaluat d. 

[0012] As stated above, on of the objects of this in- 
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vention is to be able to use receivers fitted with low-cost 
light sensors. It is, in this sense, preferable that the sen- 
sor element matrix should have 512 x 512 sensor ele- 
ments at the most, and it is most preferred that the max- 
imum number be 320 x 256 sensor elements. In general, 
these values relate to the number of active sensors for 
processing the image. In other words, the sensor ele- 
ment matrix may have more sensor elements, but which 
are not activated for image processing. 
[0013] Once the image has been digitized the logic 
circuit analyzes the image surface. To this end, there is 
carried out a mathematical convolution preferably, par- 
ticularly an convolution kernel appropriate for a detec- 
tion of movement, along the entire image surface of the 
digitized signal or along a portion thereof. 
[0014] The logic circuit preferably comprises a spe- 
cialized electronic circuit that includes: [a] a Von Neu- 
mann type sequential central processing unit (CPU), [b] 
a parallel coprocessor, specialized in the calculation of 
the convolution over the entire image surface, and which 
includes at least 32 parallel accumulator multipliers with 
a high calculation speed for calculating the convolution 
directly on the image surface at such a calculation speed 
that the convolution is completed before a new image 
acquisition is initiated, and [c] a local RAM. In particular 
it is preferable that the calculation speed is such that it 
allows a convolution to be calculated in a time of less 
than 100 ms. 

[0015] Preferably the detection device is adapted to 
distinguish a vehicle from other objects. This is 
achieved, for example, by recognizing edges or arrises, 
forming rectangles with said edges and comparing said 
rectangles with a set of patterns. When it has detected 
a vehicle, it analyzes the relative speed between the de- 
tected vehicle and the vehicle fitted with the detection 
device from the following image. 
[001 6] A preferred embodiment of the invention con- 
templates dividing the image surface into at least two 
portions, and using different analysis techniques on 
each of said portions. Thus, in one of said portions the 
technique is the one already indicated in the foregoing 
paragraph, that is to say, in the recognition of the edges, 
the formation of rectangles, the comparison of the rec- 
tangles with a set of patterns and the comparison of two 
consecutive images to calculate the relative speed, 
while in another portion a technique is used based on a 
phase difference to obtain an estimate of the optical flow 
in a particular direction, to be precise in the direction of 
the street or road on which the vehicle is moving. 
[0017] Another analysis technique consists of detect- 
ing vertical and/or horizontal arrises clearly marked on 
the image of the road. Advantageously this technique 
also includes the follow-up, through successive images, 
of the movement of said arrises, and the calculation, 
from said follow-up, of the relative speed of the object 
(vehicle) detected to the vehicle fitted with the detection 
device. This technique is described later on in greater 
detail. 



[0018] It is also possible that more than one analysis 
technique may be used simultaneously in on or more 
of the portions into which the imag surface has been 
divided. 

5 [0019] In general, the detection device should give a 
warning signal on detecting a situation in which there is 
a collision risk. This signal should serve to give the driver 
time to avoid or correct a dangerous maneuver. In this 
sense it is evident that the warning signal should be ac- 

io tivated sufficiently in advance for the driver to be able to 
react appropriately. On considering a situation in which 
a vehicle enters a motorway, which represents an ex- 
treme situation regarding the relative speed between 
the incoming vehicle and the vehicles driving on the mo- 
ts torway, it will be understood that the detection device 
should have a wide action radius, to be able to warn the 
driver sufficiently in advance. Thus, it is preferable that 
the radius of action of the detection device be greater 
than 15 m, or better still, greater than 20 m. In this sense, 

20 the detection device covers a wider field of vision than 
strictly the blind spot. Thus, the detection device can de- 
tect situations of risk and alert the driver even when the 
situation of risk was detectable through the rear-view 
mirror. Thus the cooperation of the detection device in 

25 safe driving of the vehicle is much more extensive. 
[0020] The focussing device can comprise any usual 
optical element which is obvious to the man of the art. 
In particular, it can have a lens or a microlens integrated 
in the integrated circuit including the focussing device. 

30 it is also possible to include an electromagnetic wave 
transmission guide. This would allow, for example, the 
whole detection device to be placed at any place inside 
the vehicle, and to be connected to the outside through 
said guide. However, the small dimensions of the detec- 

35 tion device allow it to be placed inside a rear-view mirror, 
which is a preferred embodiment, or it is even possible 
to place a detection device in each of the external rear- 
view mirrors of a vehicle. 

[0021 ] To achieve small sizes, at the same time as low 
40 consumption rates and a simplification in the communi- 
cations between the different components of the detec- 
tion device, it is advisable that the electronic circuit and 
the light detector are of CMOS, DMOS, MOS, Si-Ge, 
BiCMOS technology or SOI (silicon on insulator) tech- 
45 nology, and that the light detector and the electronic cir- 
cuit are physically connected in a multi-chip module 
(MCM) on a plastics material, fiberglass (FR4), ceramic 
or silicon substrate. 

[0022] Optionally the capacity of the detection device 
50 to analyze the situations of risk may be improved if, to 
the characteristics of detection of an approaching ob- 
ject, there is added the capacity detecting whether the 
vehicle on which the detection device is mounted has 
initiated actions indicative of an approach to the object. 
55 in particular, it is advantageous that the detection device 
be able to detect the actuation of an indicator and/or be 
able to detect a turn of the vehicle steering wheel. 
[0023] It is also of inter st that the detection device 
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should be able to communicate various signals to th 
user or driver of the vehicle allowing the warning signal 
to be graduated depending on the collision risk. It is thus 
preferred that the indicative elements include luminous 
signals having at least two colors, where each color in- 5 
dicates a different warning level. It is also advantageous 
to include an output element allowing the pictograms to 
be shown, where said output element is a matrix of 
LED's or a graphic screen. 

[0024] A situation of risk may also occur if a passen- to 
ger of the vehicle fitted with the detection device opens 
a door without checking whether another vehicle is ap- 
proaching from behind. It is, therefore, advantageous 
that the detection device also indicates said situations 
of risk to the vehicle's passengers. * 5 
[0025] It is advantageous to allow the detection de- 
vice to act on the door locks. Thus, for example, it can 
block a door if it detects a situation of risk. 
[0026] Finally it is advantageous to add to the object 
presence detection device a device for detecting drow- 20 
siness of the driver. Preferably the drowsiness detection 
device shares most of the physical devices with the ob- 
ject presence detection device and emits an alarm sig- 
nal depending on the relative position of the vehicle fit- 
ted with the detection device to the lines marking the 25 
lanes on the road surface. 

[0027] Further advantages and features of the inven- 
tion will be appreciated from the following description 
wherein, without any limiting nature, there is described 
one preferred embodiment of the invention, with refer- 30 
ence to the accompanying drawings, in which: 

Figures 1 A - 1 D show an outline of the blind spots 
of a vehicle, the areas of direct vision and through 
the left rear-view mirror, and the area covered by a 35 
detection device according to the invention. 
Figure 2 is a simplified diagram of a detection de- 
vice according to the invention. 
Figure 3 is a front elevation view of a rear-view mir- 
ror showing five possible locations of the receiver. *o 
Figure 4 is a diagram of an image surface 
Figure 5 shows the image surface of Figure 4, di- 
vided into three portions, and 
Figure 6 is a block diagram of an algorithm accord- 
ing to the invention. 45 

[0028] By way of example, Figures 1 A to 1 D schemat- 
ically illustrate the areas visible through the left side 
(driver's side) rear-view mirror 1 , the areas visible as a 
result of the driver's lateral peripheral vision 3, and the so 
blind spots 5. The areas visible through the rear-view 
mirrors 1 must comply with a number of legal require- 
ments, for example those defined in E.C. Directive 
71/127 and in the following directives. In particular, as 
shown in Figure 1 A, the angle of vision should be such ss 
that at a distance of 1 0 m from the rear-view mirror, the 
width of the area seen should be at least 2.5 m. In Figure 
1 A there is to be seen a hatched rectangular area cor- 



responding to the legal requirement, and a triangular ar- 
ea corresponding to what is really seen through a con- 
ventional rear-view mirror satisfying the legal require- 
ment. 

[0029] it is precisely these blind spots 5 that it is want- 
ed to cover with the detection device. The detection de- 
vice should, furthermore, partially overlap with the area 
seen in the rear-view mirror, in order to avoid disconti- 
nuities between what the sensor detects and what the 
driver sees. For this same reason it is desirable that the 
sensor should also cover part of the area seen directly 
by the driver. In this sense, one possible solution con- 
sists of using a detection device that covers an area 
such as the shaded one in Figure 1C: a right angle tri- 
angular shaped area the sides of which are both 4.5 m 
followed by a rectangular area 4.5 m wide. The total 
length of the covered area may be made to depend on 
the capabilities of the detection device. By way of ex- 
ample, Figure 1C shows a range of 20 m, although the 
detection device described hereinafter has a range of 
more than 20 m. 

[0030] Figure 1D is a combined illustration of all the 
previous areas together. It will be seen that the blind spot 
is practically entirely covered, as far as the area corre- 
sponding to the adjacent lane is concerned. There is al- 
so an overlap with the areas seen directly or through the 
rear-view mirror. 

[0031] The detection device of the invention shown in 
Figures 2 to 5 comprises a receiver 7 that it is formed 
by a matrix of 256 rows of photodiodes, with 320 pho- 
todiodes in each row. The receiver 7 receives the elec- 
tromagnetic waves coming from the exterior, in this par- 
ticular case inside the range of the visible light, suitably 
focused thanks to a lens. When the light impacts on the 
photodiodes, these generate an electrical current, the 
intensity of which depends on the intensity of the light 
received. This electrical current is converted into a volt- 
age. By selecting a row and a position inside the row, it 
is possible to select a photodiode, which thus transmits 
the electrical signal to an electronic circuit 9. The elec- 
tronic circuit 9 is provided with an amplifier stage 1 1 , and 
an analog-digital conversion unit ADC, which outputs a 
digitized signal. 

[0032] The digitized signal is fed into a logic circuit 15. 
The logic circuit 1 5 comprises a Von Neumann type se- 
quential central processing unit CPU, a parallel coproc- 
essor TOT that calculates the convolution and is based 
on an auxiliary memory MEM, a FLASH memory and a 
rapid access static RAM (SRAM). The central process- 
ing unit CPU also controls the receiver 7, sending the 
row selection signals 1 7 and position inside the row sig- 
nals 1 9 to the corresponding registers, and to the elec- 
tronic circuits. 

[0033] The receiver 7 picks up an image, including the 
blind spot, that is projected on the image surface formed 
by the photodiodes. It is this image surface which is 
transmitted to the logic circuit 15 in form of a number of 
digitized pixels. The receiv r 7 is orientated in such a 
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way that the side edge of the image surface is practically 
flush with the side surface of the motor vehicle 21 and 
the upper edg of the image surface is flush with the 
horizon 23. The logic circuit 15 determines the direction 
of movement along the street or road, which allows it to 
determine whether a detected movement is in the direc- 
tion of the road or if it is in another direction, for example 
vertical. Thus it can filter "noises", such as may be rain, 
snow, vehicles moving in the opposite direction, etc. 
[0034] Figure 3 shows some examples of positioning 
of the receiver 7 or, in the case may be, of the end of 
the electromagnetic wave guide, in an external rear- 
view mirror. 

[0035] As has already been indicated previously, var- 
ious image analysis algorithms may be effected. In one 
case the image surface is divided in two portions 25, 27 
having an overlap area 29, as shown in Figure 5. The 
logic circuit 15 has two independent algorithms: a vehi- 
cle detecting algorithm that is applied in portion 25, and 
a movement detecting algorithm that is applied in por- 
tion 27. Both algorithms are applied in the overlap area 
29. The vehicle detecting algorithm recognizes the edg- 
es of figures existing on the image surface, selects the 
horizontally and vertically disposed edges and is com- 
pared with certain patterns to determine whether there 
is an object having a shape similar to that of a vehicle. 
In the affirmative, the next image obtained by the receiv- 
er 7 is analyzed, which allows the direction of the move- 
ment, as well as the speed of the object, to be deter- 
mined. The movement detecting algorithm is based on 
a phase difference technique to obtain an estimate of 
the optical flow in the direction of the road. The result is 
compared with the results obtained in previous images, 
to eliminate errors and noises by means of a consisten- 
cy check. 

[0036] Another possible image analysis algorithm is 
based on the following. As already said above, the de- 
vice is designed to detect vehicles overtaking the vehi- 
cle fitted with the device by means of the series of im- 
ages captured with a digital camera, for example a 
CMOS camera, mounted in the rearview mirror of a ve- 
hicle. 

[0037] The presence of an approaching vehicle is 
based on the detection and follow-up of objects moving 
along the axis of the road (in general any public way) 
and drawing closer to the vehicle fitted with the device. 
Starting from an image, the presence of a vehicle may 
be appreciated by the presence of arrises (or edges) 
clearly marked in the vertical and horizontal directions 
on the road surface. In successive images these visual 
elements (the vertical and horizontal arrises) move for- 
wardly if they are part of an approaching vehicle. On the 
contrary, they move backwards if they are part of static 
objects (such as elements of the highway, protective 
barriers, trees, traffic signals, milestones, etc.) or if they 
belong to vehicles moving the opposite direction to the 
vehicle fitted with the device. Therefore a coherent for- 
ward movement is interpreted as an overtaking vehicle. 



[0038] This interpretation is generally correct on mo- 
torways or similar roads, where the lanes are clearly d - 
fined and the curves usually have a large radius. In 
these cases the image is a simple perspectiv view and 

5 the overtaking lane can be isolated in a simple way from 
the rest of the scene using an appropriate mask. There- 
fore, a forward movement in the overtaking lane is a 
clear indication of an approaching vehicle. Noises and 
interference due to holes in the road or abrupt move- 

w ments of the vehicle fitted with the device can be elimi- 
nated by requiring that the forward movement be coher- 
ent through various successive images. 
[0039] The visual image on a road that is not a motor- 
way or the like is much more complex. In particular, the 

is turns to the left of the vehicle fitted with the device can 
generate a consistent apparent movement which may 
generate false alarms. This is particularly frequent in ur- 
ban environments, where the visual scene contains a 
large number of objects (parked cars, buildings, diverse 

20 traffic signs, etc.) having marked arrises. Furthermore 
the true distance between the approaching vehicle and 
the vehicle fitted with the device cannot be correctly es- 
timated from its position, since the lanes are not clearly 
defined. Forthis reason it is desirable that the detecting 

25 device should have a specific operation module for 
when the device carrying vehicle is turning to the left. 
Thus, during a turn to the left, the detection field moves 
to a position closer to the vehicle fitted with the device 
and more restrictive requirements are imposed before 

30 activating the alarm signal. As consequence the alarm 
signal will be activated when the approaching vehicle is 
closer to the vehicle fitted with the device. However this 
is not a problem because around tight curves the vehicle 
speeds are slower than on motorways or other fast 

35 roads. Furthermore, in view of the configuration of the 
street and the frequent presence of intersections, a long 
detection range is not necessary in the case of an urban 
environment. 

[0040] As a particular example the camera may be 
40 provided with a sensor that is a 320 x 256 CMOS matrix 
with a high dynamic range (120 dB). The size of the 
processed images is at least 128 x 128 pixels. The field 
of vision of the camera is approximately 55°. The cam- 
era is positioned in such a way that: 

45 

- the left vertical edge of the image is close to the side 
edge of the vehicle fitted with the device, 
the upper edge of the image is lightly above the ho- 
rizon line, by approximately one eighth of the image. 
50 - the camera is slightly tilted in the clockwise direction 
so that it aligns the image along the axis of the high- 
way. 

[0041 ] A mask is used that is controlled from the soft- 
55 ware that defines the region of interest of the images. 
The mask is positioned in such a way that a car located 
in the overtaking lane of a straight road and at a great 
distance is positioned in the left upper end of the mask. 
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The position of the mask in the image can be adjusted 
to get a fine adjustment of the field of vision. 
[0042] So that the detection device may work appro- 
priately the image capture speed should preferably be 
in excess of 40 images per second, since in this way the 
device is capable of following the trajectory of the ap- 
proaching vehicles with greater accuracy. The detection 
device algorithm has four main modules basically: 

An optical flow detection module. The algorithm us- 
es a technique based on phase differences to pro- 
duce a dense estimate of the optical flow in the di- 
rection of the axis of the road. To this end a pair of 
successive images is processed. Visual elements 
that are not moving forward are filtered and elimi- 
nated. The resulting images are fed to the following 
modules. This module is optional and may be not 
used. 

Vehicle detection and follow-up module. In the re- 
gion defined by the mask the algorithm calculates 
the arrises of the image and their directions. The 
vertical arrises and the horizontal arrises are nor- 
malized and integrated along the vertical and hori- 
zontal axes respectively. The normalization factor 
is adjusted dynamically based on the average den- 
sity of the arris. The unidirectional projection of said 
arrises on the corresponding coordinates axis is 
used to trace the trajectory according to said axis. 
Approaching objects generate projections with pos- 
itive speeds, that is to say to the right and down- 
wardly of the image. These points are separated 
from other points that are stationary or have relative 
movements with the aid of directional filters. The re- 
sulting trajectories are identified and selected. 
Module for detection of vehicles without relative 
speed. Once the trajectory of an approaching vehi- 
cle has been identified (by means of the displace- 
ment of its corresponding unidirectional projec- 
tions) the speed of the vehicle is estimated and su- 
pervised. Therefore it is possible to detect situations 
in which this approaching vehicle reduces speed 
and circulates at the same speed as the vehicle fit- 
ted with the device, staying at a short distance from 
the vehicle fitted with the device. In these cases it 
is possible to emit a specific type of alarm signal 
until substantial changes (dropping behind or over- 
taking the vehicle fitted with the detection device) 
are observed in the environment of the image of the 
approaching vehicle. In other words, this module al- 
lows for control of traffic situations (for example 
dense traffic) where parallel circulation takes place, 
namely, vehicles circulating in different lanes at 
practically the same speed, in these cases it is rel- 
atively frequent for a vehicle to be positioned in the 
blind spot of another vehicle, which may generate 
situations of danger. 

Left turn detection module. During left turns, there 
occurs a constant overall displacement of the visual 



elements contained in differ nt images. The con- 
stant displacements are detected in the upper por- 
tion of successive images by means of a correla- 
tions technique. The coherence of this signal during 
5 a number of successive images is used as an indi- 
cation that the vehicle fitted with the device is turn- 
ing and, therefore, that the left turn detection mod- 
ule should be activated. 

w [0043] Figure 6 shows a block diagram in which the 
stages of the algorithm are illustrated. The reference 
numbers given represent the following blocks: 

6.1 Initialization of the algorithm 
is 6.2 Image acquisition 

6.3 Optical flow estimate 

6.4 Left turn detecting 

6.5 Vehicle detection and follow-up 

6.6 Consistent forward movement? Vehicles with 
20 zero relative speed? 

6.7 Activate alarm 

[0044] First of all, the optical flow module 6.3 carries 
out a coarse filtering of the image flow, basing itself on 

25 the direction of the movement. Then, the left turn module 
6.4 warns the system whether the vehicle fitted with the 
device is turning. Next the detection and follow-up sys- 
tem 6.5 follows the trajectories of the moving objects 
and activates, if required, the corresponding alarm sig- 

30 nal. Next, if the alarm is activated, the zero speed mod- 
ule is activated. 

[0045] Two modes of operation may be established. 
If the vehicle fitted with the device is not turning, only 
the projections of the trajectories along the horizontal 

35 axis are considered. If the follow-up module detects a 
trajectory longer than 1 5 images, an alarm signal is gen- 
erated and it gives an estimate of the relative distance 
and the relative speed of the approaching vehicle. This 
indication is reliable in the case of flat, straight roads, 

40 such as motorways or the like. 

[0046] If the left turn detector is activated the require- 
ments for the alarm to be activated are stricter. First the 
images are filtered using the optical flow detector, in or- 
der to reduce the noise, and the two projections (along 

45 the vertical axis and along the horizontal axis) are taken 
into consideration. Only if a visual effect is moving for- 
ward both on the X axis and on the Y axis is the alarm 
signal activated. This is done this way, since during the 
turns the visual elements are characterized by having a 

so positive speed according to the X axis, but with an ap- 
proximately null speed according to the Y axis, since the 
height thereof is maintained. Additionally the position of 
the mask is lowered and moves to the right to cover the 
region of interest (the overtaking lane) of the images. 

55 [0047] Then, the logic circuit, depending on the infor- 
mation obtained (vehicle presence, distance of the ve- 
hicle, and relative speed) activates, for example, a 
group of three different colored LEDs (red, amber, 
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green) (not shown in the Figures), allowing it to commu- 
nicate different warning levels, depending on the dan- 
ger. A plurality of ways of presenting the warning levels 
is possible: from a single red luminous signal that is ac- 
tivated to indicate the presence of a object in the detec- 
tion area, through to complex devices, with diverse lu- 
minous, acoustic and tactiie signals. 
[0048] The detection device has a range of more than 
20 m. Thus, in the situation previously indicated by way 
of example, in which a vehicle wants to enter a motor- 
way, a case in which there may be relative speeds of 
the order of 120 km/h, the driver receives the warning 
signal with almost 1 s of time. 

[0049] Where the detection device is mounted simul- 
taneously on two external rear-view mirrors (one in each 
side of the vehicle), it is possible to add thereto, addi- 
tionally, a driver drowsiness detection device. Prefera- 
bly the drowsiness detection device shares all the phys- 
ical elements of the object presence detection device 
that participate in the capture and processing of images, 
such as the receiver, the electronic circuit and the logic 
circuit. Additionally the drowsiness detection device has 
an algorithm that allows drowsiness to be detected in 
the way described herebelow. 
[0050] By means of the images obtained through 
each of the object presence detection devices disposed 
in each of the rear-view mirrors, the marking lines of the 
lane in which the vehicle fitted with the detection device 
is driving are detected. Thus it is possible to detect when 
the vehicle fitted with the device crosses one of said 
marking lines. Indeed, as a consequence of drowsiness, 
the driver is no longer able to follow the lane, marked by 
the marking lines, and leaves it, creating a situation of 
danger. The drowsiness detector is capable, therefore, 
of detecting this circumstance and of emitting an alarm 
signal. 

[0051] To recognize said marking lines, the drowsi- 
ness detection device analyzes the image in the region 
immediately behind the car, it extracts the edges of the 
marking lines (the arrises thereof) and follows them in 
time. The distance between the wheel and the edge of 
the marking line can be detected and it is thus possible 
to emit an alarm signal when the veh icle is about to cross 
over said line. Preferably the drowsiness detection de- 
vice is connected to the turn detection module, allowing 
it to identify the case in which the marking line is ap- 
proached, because the vehicle is negotiating a curve. 
Also the drowsiness detection device receives informa- 
tion on the possible activation of the indicators, allowing 
it to discern a voluntary crossing of the marking lines 
from an involuntary or, at least, unnotified crossing. 
[0052] If the drowsiness detection device detects an 
inadvertent crossing of a marking line, it activates a 
warning signal. This warning signal may be tactile (for 
example vibrations in the steering wheel), luminous and/ 
or acoustic. 

[0053] It is also possible to make a drowsiness detec- 
tion device from a single object presence detection de- 



vice, disposed in a single rear-view mirror, although in 
this case it is likely that the benefits ther of, in the sense 
of the quality or relevancy of the warning signals it emits, 
will not be the sam . 
5 [0054] The drowsiness detection device is always di- 
rected to the rear, and covers exactly the same area of 
detection as the object presence detection device, since 
it preferably shares therewith all the physical detection 
and calculation elements. 

10 

Claims 

1. An object presence detection device, of the type 
15 mounted to a motor vehicle, said vehicle having at 

least one blind spot, where said detection device is 
for detecting an object situated in said blind spot, 
comprising: [a] a receiver (7) for detecting electro- 
magnetic waves, said receiver (7) comprising a fo- 

20 cussing device, and a light detector converting said 
received electromagnetic waves into electrical sig- 
nals, said light detector defining an image surface, 
[b] an electronic circuit (9) converting said electrical 
signals into digitized signals, [c] a logic circuit (15) 

25 analyzing said digitized signals to analyze the pres- 
ence of objects in the blind spot which are moving 
relative to said vehicle, and generating variable out- 
put signals depending on the result of said analysis, 
[d] indicator members activated by said output sig- 

30 nals. 

2. The detection device according to claim 1 , wherein 
said light detector is constituted by active sensor el- 
ements having a dynamic range equal or superior 

35 to six decades on one same image surface, and 
wherein one same sensor element has a dynamic 
range equal or superior to the six decades between 
two consecutive images. 

*o 3. The detection device according to claim 1 or claim 
2, wherein said light detector is constituted by pho- 
todiodes for converting said electromagnetic waves 
into an electrical current. 

45 4. The detection device according to claim 3, wherein 
said electrical current is converted into an electrical 
voltage and because said electrical voltage is am- 
plified. 

50 5. The detection device according to at least one of 
claims 1 to 4, wherein said light detector comprises 
a two-dimensional matrix of said sensor elements 
defining a number of rows of sensor elements, 
where each of said rows extends in a first direction 

55 and is parallel to the remaining rows, and where the 
group of rows forms said image surface. 

6. The detection device according to claim 5, wherein 
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said electronic circuit (9) makes a selection of each 
of said sensor elements by activating the corr - 
sponding row and th corresponding position in 
said row, it being possible in this way to select any 
sensor element after any sensor element. 

7. The detection device according to claim 5, wherein 
said electronic circuit (9) simultaneously converts 
all said electrical signals from a row of sensor ele- 
ments to digitized signals. 

8. The detection device according to at least one of 
claims 1 to 7, wherein said electronic circuit (9) com- 
prises an amplifier stage (11) and a digitization 
stage (ADC). 

9. The detection device according to at least one of 
claims 5 to 8, wherein each row is provided with at 
the most 512 active sensor elements for process- 
ing, and is provided with at the most 51 2 active rows 
of sensor elements for processing the image. 

10. The detection device according to at least one of 
claims 5 to 8, wherein each row is provided with at 
the most 320 active sensor elements for processing 
the image, and is provided with at the most 256 ac- 
tive rows of sensor elements for processing the im- 
age. 

11. The detection device according to at least one of 
claims 1 to 10, wherein said logic circuit (15) carries 
out a mathematical convolution along the entire 
said image surface of the digitized signal. 

1 2. The detection device according to claim 1 1 , wherein 
said mathematical convolution over the entire said 
image surface is carried out by means of a convo- 
lution kernel appropriate for a movement detection. 

13. The detection device according to at least one of 
claims 1 to 12, wherein said logic circuit (15) is for 
detecting movement in at least one direction, said 
direction being adjustable depending on the loca- 
tion of said focussing device, and wherein said logic 
circuit (15) is capable of determining the relative 
speed of said movement in said direction. 

14. The detection device according to at least one of 
claims 11 to 13, wherein said logic circuit (15) com- 
prises a specialized electronic circuit including: [a] 
a Von Neumann type sequential central processing 
unit (CPU), [b] a parallel coprocessor (TOT), spe- 
cialized in the calculation of said convolution over 
the entire said image surface, said coprocessor in- 
cluding at least 32 parallel accumulator multipliers 
with a high calculation speed for calculating said 
convolution directly on the image surface at such a 
calculation speed that the convolution is completed 
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before a new image acquisition is initiated, and [c] 
a local RAM (SRAM). 

15. The detection device according to at least one of 
5 claims 11 to 14, wherein said convolution is calcu- 
lated in a time no greater than 1 00 ms. 

16. The detection device according to at least one of 
claims 1 to 15, wherein it is adapted to distinguish 

10 a vehicle from other objects. 

1 7. The detection device according to claim 1 6, wherein 
said distinguishing is effected by recognizing arris- 
es, clearly marked in the vertical and horizontal di- 

15 rections on the road surface, in an image. 

18. The detection device according to claim 16 or claim 
17, wherein if it has detected a vehicle, it analyzes 
said relative speed from the following image. 

20 

19. The detection device according to at least one of 
claims 1 to 1 8, wherein it divides said image surface 
in at least two portions (25, 27, 29), and wherein in 
each of said portions (25, 27, 29) it uses different 

25 analysis techniques. 

20. The detection device according to claim 1 9, wherein 
in one of said portions (25, 29) said technique con- 
sists of recognizing said arrises and the follow-up 

30 thereof through various images to calculate said rel- 
ative speed. 

21 . The detection device according to claim 1 9 or claim 
20, wherein in at least one of said portions (27, 29) 

35 a technique is used based on a phase difference to 
obtain an estimate of the optical flow in one direc- 
tion. 

22. The detection device according to at least one of 
40 claims 1 to 21, having an action radius of at least 

15 meters. 

23. The detection device according to at least one of 
claims 1 to 22, wherein said focussing device com- 

45 prises at least one lens. 

24. The detection device according to at least one of 
claims 1 to 23, wherein said focussing device com- 
prises an electromagnetic wave transmission guide 

so for guiding the electromagnetic waves from a first 
area, facing said blind spot, to a second area, where 
said electronic circuit (9) is accommodated. 

25. The detection device according to at least one of 
55 claims 1 to 24, wherein said electromagnetic waves 

are visible waves. 

26. The detection device according to at least one of 
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claims 1 to 25, wherein said electronic circuit (9) is 
CMOS, DMOS, MOS, Si-Ge or BiCMOS technolo- 
gy 

27. The detection device according to at least one of 
claims 1 to 26, wherein said light detector is CMOS, 
DMOS, MOS, Si-Ge or BiCMOS technology. 

28. The detection device according to at least one of 
claims 1 to 27, wherein said electronic circuit (9) is 
SOI (silicon on insulator) technology. 

29. The detection device according to at least one of 
claims 1 to 28, wherein said light detector is SOI 
(silicon on insulator) technology. 

30. The detection device according to at least one of 
claims 1 to 29, wherein said light detector and said 
electronic circuit (9) are physically united in a multi- 
chip module (MCM) on a plastics material, glass fib- 
er (FR4), ceramic or silicon substrate. 

31 . The detection device according to at least one of 
claims 1 to 30, wherein said focussing device com- 
prises a microlens integrated in an integrated circuit 
including said focussing device. 

32. The detection device according to at least one of 
claims 1 to 31 , wherein said light detector is housed 
inside the vehicle external rear-view mirror unit. 

33. The detection device according to claim 32, having 
a light detector in each of the vehicle external rear- 
view mirrors. 

34. The detection device according to at least one of 
claims 1 to 33, additionally detecting whether said 
vehicle has initiated actions indicative of an ap- 
proach to said object. 

35. The detection device according to claim 34, wherein 
said indicative actions comprise the activation of an 
indicator. 

36. The detection device according to one of claims 34 
or 35, wherein said actions comprise turning a 
steering wheel. 

37. The detection device according to at least one of 
claims 1 to 36, wherein said indicative elements in- 
clude luminous signals of at least two colors, where 
each color indicates a different warning level. 

38. The detection device according to at least one of 
claims 1 to 37, wherein said indicative elements in- 
clude an output element allowing pictograms to be 
shown, where said output element is a matrix of 
LEDs or a screen. 



39. The detection device according to at least one of 
claims 1 to 38, where said vehicle is provided with 
doors having a safety lock, being adapted to act on 
said lock. 

5 

40. The detection device according to at least one of 
claims 1 to 39, additionally comprising a driver 
drowsiness detection device. 

10 41 . The detection device according to claim 40, wherein 
said drowsiness detection device shares said re- 
ceiver (7), said electronic circuit (9) and said logic 
circuit (15) with said object presence detection cir- 
cuit. 

15 

42. The detection device according to one of claims 40 
or 41, wherein said drowsiness detection device 
emits an alarm signal depending on the position of 
said motor vehicle relative to marking lines. 

20 
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